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(57) An electronic mail system connected to a net- 
work includes a section for converting an image of a doc- 
ument surface into corresponding document image da- 
ta, and a section for compressing the document image 
data into compression-resultant image data. The elec- 
tronic mail system also includes a section for converting 
the compression-resultant image data into correspond- 
ing image data of a given electronic-mail format, a sec- 
tion for receiving information of an electronic-mail des- 
tination address, and a section for transmitting the im- 
age data of the electronic-mail format toward the elec- 
tronic-mail destination address via the network. The 
electronic mail system may further include a section for 
receiving image data in an electronic mail, a section for 
converting the received image data into corresponding 
received image data of a given facsimile format, a sec- 
tion for expanding the received image data of the fac- 
simile format into expansion-resultant image data, and 
a section for printing the expansion-resultant image da- 
ta. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001 ] This invention relates to an electronic mail sys- 
tem which can handle image information. 

Description of the Prior Art 

[0002] Japanese published unexamined patent appli- 
cation 2-172348 discloses a facsimile apparatus which 
includes an interface for connection with a computer 
network, and a controller for enabling an electronic mail 
to be outputted to the computer network via the inter- 
face. The facsimile apparatus is also connected to a tel- 
ephone line to receive and output image information 
from and to the telephone line. In Japanese application 
2-1 72348, the electronic mail outputted to the computer 
network represents a facsimile transmission result re- 
port or a facsimile reception result report rather than im- 
age information. 

[0003] United States Patent 5,479,41 1 discloses that 
voice, facsimile, and electronic mail messaging is inte- 
grated in a system which converts e-mail messages into 
voice-and-fax messages. An e-mail message is parsed 
into voiceable, prose, segments and non-voiceable, 
non-prose, segments. Prose segments are converted 
into voice message segments via text-to-speech facili- 
ties. Each non-prose segment is converted into a fax 
segment. Voice pointers to fax segments are inserted 
into the voice message, in places corresponding to the 
non-prose segments in the e-mail message. The voice 
file and fax file are then stored for subsequent delivery 
of the message as an integrated voice-and-fax mes- 
sage. Conversion of integrated voice-and-fax messag- 
es into e-mail messages is likewise envisioned. 

SUMMARY OF THE INVENTION 

[0004] It is an object of this invention to provide an 
improved electronic mail system. 
[0005] A first aspect of this invention provides an elec- 
tronic mail system connected to a network which com- 
prises means for converting an image of a document 
surface into corresponding document image data; 
means for compressing the document image data into 
compression-resultant image data; means for convert- 
ing the compression-resultant image data into corre- 
sponding image data of a given electronic-mail format; 
means for receiving information of an electronic-mail 
destination address; and means for transmitting the im- 
age data of the electronic-mail format toward the elec- 
tronic-mail destination address via the network. 
[0006] A second aspect of this invention is based on 
the first aspect thereof , and provides an electronic mail 
system further comprising means for receiving image 



data in an electronic mail; means for converting the re- 
ceived image data into corresponding received image 
data of a given facsimile format; means for expanding 
the received image data of the facsimile format into ex- 

5 pansion -resultant image data; and means for printing 
the expansion-resultant image data. 
[0007] A third aspect of this invention is based on the 
first aspect thereof, and provides an electronic mail sys- 
tem further comprising means for transmitting character 

io code data by an electronic mail. 

[0008] A fourth aspect of this invention is based on 
the first aspect thereof, and provides an electronic mail 
system wherein the destination-address receiving 
means comprises means for recognizing an electronic- 

15 mail destination address in a given position of the image 
data. 

[0009] A fifth aspect of this invention is based on the 
first aspect thereof, and provides an electronic mail sys- 
tem further comprising means for receiving information 
20 of an electronic-mail sender address as information of 
an electronic-mail source address, and means for, in 
cases where atransmission failure occurs, informingthe 
electronic-mail source address of the transmission fail- 
ure. 

25 [001 0] A sixth aspect of this invention is based on the 
first aspect thereof, and provides an electronic mail sys- 
tem further comprising means for receiving audio data, 
means for integrating the audio data and the image data 
into integration-resultant data, and means for transmit- 
so ting the integration-resultant data as a single electronic 
mail. 

[001 1 ] A seventh aspect of this invention is based on 
the first aspect thereof, and provides an electronic mail 
system further comprising means for receiving moving- 
35 picture data, means for integrating the moving-picture 
data and the image data into integration-resultant data, 
and means for transmitting the integration-resultant da- 
ta as a single electronic mail. 

[0012] An eighth aspect of this invention is based on 

40 the third aspect thereof, and provides an electronic mail 
system further comprising means for analyzing a char- 
acter sequence in a given position of received character 
code data, and means for implementing a process in re- 
sponse to a result of said analyzing. 

45 [0013] A ninth aspect of this invention is based on the 
eighth aspect thereof, and provides an electronic mail 
system further comprising means for, in cases where the 
analyzed character sequence indicates registration of a 
destination mail address, registering sender ID informa- 

50 tion in a subsequent character seq uence and a plurality 
of destination mail addresses while providing a corre- 
spondence relation between the sender ID information 
and the destination mail addresses, and means for, in 
cases where sender ID information is received during 

55 mail transmission and the sender ID information is equal 
to the registered sender ID information, indicating the 
corresponding destination mail addresses and selecting 
a necessary destination from among the destination 
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mail addresses. 

[001 4] A tenth aspect of this invention is based on the 
eighth aspect thereof, and provides an electronic mail 
system further comprising means for, in cases where the 
analyzed character sequence indicates registration of a 
source mail address, registering sender ID information 
in a subsequent character sequence and a source mail 
address while providing a correspondence relation be- 
tween the sender ID information and the source mail ad- 
dress, and means for, in cases where sender ID infor- 
mation is received during mail transmission and the 
sender ID information is equal to the registered sender 
ID information, receiving the corresponding source mail 
address as a source. 

[0015] An eleventh aspect of this invention is based 
on the ninth aspect thereof, and provides an electronic 
mail system further comprising means for, in cases 
where sender ID information is received during mail 
transmission and the sender ID information is equal to 
the registered sender ID information, writing information 
of a source mail address corresponding to the sender 
ID information into a header of a mail as a source. 
[0016] A twelfth aspect of this invention is based on 
the second aspect thereof, and provides an electronic 
mail system further comprising means for providing a 
connection to a telephone line, and means for selective- 
ly transmitting the image data via the connection to the 
telephone line according to a facsimile procedure or via 
the network according to an electronic-mail procedure. 
[0017] A thirteenth aspect of this invention is based 
on the twelfth aspect thereof, and provides an electronic 
mail system further comprising means for analyzing a 
character sequence in a given position of character 
code data in a received electronic mail, means for, in 
cases where the analyzed character sequence indi- 
cates wait for facsimile data reception, recognizing a no- 
tice electronic-mail address in a subsequent character 
sequence, means for, in cases where image data is re- 
ceived via the connection to the telephone line accord- 
ing to a facsimile procedure after the notice electronic- 
mail address is recognized, transmitting an electronic 
mail representative of a reception notice to the notice 
electronic-mail address. 

[0018] A fourteenth aspect of this invention is based 
on the twelfth aspect thereof, and provides an electronic 
mail system further comprising means for analyzing a 
first character sequence in a given position of a header 
of image data in a received electronic mail, means for, 
in cases where the analyzed character sequence indi- 
cates facsimile transmission, recognizing a second 
character sequence in a given position of the header ex- 
cept the first character sequence as a facsimile number, 
and means for transmitting the received image data to- 
ward the facsimile number via the connection to the tel- 
ephone line according to a facsimile procedure. 
[0019] A fifteenth aspect of this invention is based on 
the first aspect thereof, and provides an electronic mail 
system further comprising means for identifying a coun- 
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try having a destination in response to the destination 
address, means for generating information of standard 
time in the identified country, and means for transmitting 
the image data as an electronic mail at a desired mo- 
5 ment expressed according to the standard time in the 
identified country. 

[0020] A sixteenth aspect of this invention is based on 
the second aspect thereof, and provides an electronic 
mail system further comprising means for registering a 
10 plurality of electronic-mail addresses, means for storing 
and managing image data transmitted by an electronic 
mail for each of the electronic-mail addresses, means 
for setting pass words for the respective electronic-mail 
addresses, and means for outputting the stored image 
15 data when a related pass word is received. 

[0021 ] A seventeenth aspect of this invention is based 
on the sixteenth aspect thereof, and provides an elec- 
tronic mail system further comprising means for gener- 
ating information of a cover sheet for each of the elec- 
ta tronic-mail addresses, and means for adding the infor- 
mation of the cover sheet and outputting a resultant of 
said adding. 

[0022] An eighteenth aspect of this invention is based 
on the second aspect thereof, and provides an electron- 
's ic mail system further comprising means for, in cases 
where a first electronic mail is received, transmitting a 
second electronic mail representative of reception of the 
first electronic mail to a sender electronic-mail address 
related to the first electronic mail. 
30 [0023] A nineteenth aspect of this invention is based 
on the second aspect thereof, and provides an electron- 
ic mail system further comprising means for writing re- 
ception ID information for each received electronic mail, 
means for providing a correspondence relation between 
35 a sender electronic-mail address related to the received 
electronic mail and reception ID information, and means 
for, in cases where the reception ID information is re- 
ceived, transmitting a conformation electronic mail to 
the sender electronic-mail address. 
40 [0024] A twentieth aspect of this invention is based on 
the second aspect thereof, and provides an electronic 
mail system further comprising means for, in cases 
where transmission of a received electronic mail fails, 
printing information representative of a transmission 
45 failure, and means for outputting information of a first 
page of the image data. 

[0025] A twenty-first aspect of this invention is based 
on the first aspect thereof, and provides an electronic 
mail system further comprising means for receiving 
50 character code data by an electronic mail. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0026] Fig. 1 is a block diagram of an electronic mail 
55 system according to a first embodiment of this invention. 
[0027] Fig. 2 is a flowchart of a segment of a program 
for controlling a CPU in Fig. 1 . 
[0028] Fig. 3 is a block diagram of an electronic mail 
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system according to a second embodiment of this in- 
vention. 

[0029] Fig. 4 is a flowchart of a segment of a program 
for controlling a CPU in Fig. 3. 
[0030] Fig. 5 is a block diagram of an electronic mail 
system according to a third embodiment of this inven- 
tion. 

[0031 ] Fig. 6 is a flowchart of a segment of a program 
for controlling a CPU in Fig. 5. 
[0032] Fig. 7 is a block diagram of an electronic mail 
system according to a fourth embodiment of this inven- 
tion. 

[0033] Fig. 8 is a flowchart of a segment of a program 
for controlling a CPU in Fig. 7. 
[0034] Fig. 9 is a block diagram of an electronic mail 
system according to a fifth embodiment of this invention. 
[0035] Fig. 1 0 is a flowchart of a segment of a program 
for controlling a CPU in Fig. 9. 
[0036] Fig. 11 is a block diagram of an electronic mail 
system according to a sixth embodiment of this inven- 
tion. 

[0037] Fig. 12 is a flowchart of a first segment of a 
program for controlling a CPU in Fig. 11 . 
[0038] Fig. 13 is a flowchart of a second segment of 
the program for controlling the CPU in Fig. 11 . 
[0039] Fig. 1 4 is a block diagram of an electronic mail 
system according to a seventh embodiment of this in- 
vention. 

[0040] Fig. 1 5 is a flowchart of a segment of a program 
for controlling a CPU in Fig. 14. 
[0041 ] Fig. 1 6 is a block diagram of an electronic mail 
system according to an eighth embodiment of this in- 
vention. 

[0042] Fig. 1 7 is a diagram of a part of an example of 
an e-mail in a given format. 

[0043] Fig. 1 8 is a block diagram of an electronic mail 
system according to a ninth embodiment of this inven- 
tion. 

[0044] Fig. 19 is a flowchart of a first segment of a 
program for controlling a CPU in Fig. 18. 
[0045] Fig. 20 is a flowchart of a second segment of 
the program for controlling the CPU in Fig. 18. 
[0046] Fig. 21 is a block diagram of an electronic mail 
system according to a tenth embodiment of this inven- 
tion. 

[0047] Fig. 22 is a flowchart of a first segment of a 
program for controlling a CPU in Fig. 21 . 
[0048] Fig. 23 is a flowchart of a second segment of 
the program for controlling the CPU in Fig. 21 . 
[0049] Fig. 24 is a block diagram of an electronic mail 
system according to a twelfth embodiment of this inven- 
tion. 

[0050] Fig. 25 is a flowchart of a segment of a program 
for controlling a CPU in Fig. 24. 
[0051] Fig. 26 is a flowchart of a segment of a program 
for controlling a CPU in an electronic mail system ac- 
cording to a thirteenth embodiment of this invention. 
[0052] Fig. 27 is a flowchart of a segment of a program 



for controlling a CPU in an electronic mail system ac- 
cording to a fourteenth embodiment of this invention. 
[0053] Fig. 28 is a block diagram of an electronic mail 
system according to a fifteenth embodiment of this in- 
5 vention. 

[0054] Fig. 29 is a flowchart of a segment of a program 
for controlling a CPU in Fig. 28. 
[0055] Fig. 30 is a flowchart of a segment of a program 
for controlling a CPU in an electronic mail system ac- 

10 cording to a sixteenth embodiment of this invention. 
[0056] Fig. 31 is a flowchart of a segment of a program 
for controlling a CPU in an electronic mail system ac- 
cording to an eighteenth embodiment of this invention. 
[0057] Fig. 32 is a flowchart of a segment of a program 

15 for controlling a CPU in an electronic mail system ac- 
cording to a nineteenth embodiment of this invention. 
[0058] Fig. 33 is a flowchart of a segment of a program 
for controlling a CPU in an electronic mail system ac- 
cording to a twentieth embodiment of this invention. 

20 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

First Embodiment 

25 

[0059] With reference to Fig. 1 , an electronic mail sys- 
tem includes a CPU 1, a ROM 2, a RAM 3, a storage 
unit 4, a format converter 5, a scanner 6, an operation 
panel 7, a data compressor 8, and a LAN (local area 
30 network) controller 9 which are electrically connected 
via a bus line. 

[0060] The CPU 1 operates in accordance with a pro- 
gram stored in the ROM 2. The CPU 1 provides a work 
area in the RAM 3, and accesses and uses the work 

35 area during signal processing. The storage unit 4 in- 
cludes, for example, a hard disk device which is used in 
storing data including compression-resultant image da- 
ta of a facsimile format. The format converter 5 changes 
compression-resultant image data of the facsimile for- 

40 mat into corresponding image data of the e-mail (elec- 
tronic mail) format. The scanner 6 converts an image of, 
for example, a document sheet surface into correspond- 
ing binary image data (corresponding bi-level image da- 
ta). The operation panel 7 has a key board, a start but- 

45 ton, and other buttons. Information of the destination or 
the address of an e-mail to be transmitted can be input- 
ted into the electronic mail system by operating the key 
board on the operation panel 7. The scanner 6 can be 
activated by operating the start button on the operation 

50 panel 7. The data compressor 8 serves to compress bi- 
nary image data (bi-level image data) which is generat- 
ed by the scanner 6. The LAN controller 9 includes a 
LAN interface. 

[0061] The LAN controller 9 is connected via a LAN 
55 to an e-mail computer 9A. The e-mail computer 9A is 
connected to an e-mail network such as the Internet. 
[0062] As previously described, the CPU 1 operates 
in accordance with a program stored in the ROM 2. Fig. 
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2 is a flowchart of a segment of the program. In the case 
where the transmission of information on a document 
sheet is required, the sheet is placed in the scanner 6 
and information of a desired destination is inputted via 
the operation panel 7. Further, the start button on the 
operation panel 7 is depressed. 
[0063] With reference to Fig. 2, a first step S1 in the 
program segment decides whether or not information of 
the destination or the address of an e-mail to be trans- 
mitted has been inputted via the operation panel 7. In 
addition, the step S1 decides whether or not the start 
button on the operation panel 7 has been depressed. In 
the case where information of the destination of an e- 
mail to be transmitted has been inputted and the start 
button on the operation panel 7 has been depressed, 
the program advances from the step S1 to a step S2. 
Otherwise, the program repeats the step S1 . Thus, the 
step S1 waits the reception of an e-mail destination and 
the depression of the start button. 
[0064] The step S2 activates the scanner 6 so that an 
image of the surface of a document sheet in the scanner 
6 is converted by the scanner 6 into corresponding bi- 
nary image data (corresponding bi-level image data). A 
step S3 following the step S2 transfers the binary image 
data from the scanner 6 to the data compressor 8. Then, 
the step S3 activates the data compressor 8 so that the 
binary image data is compressed by the device 8 into 
compression-resultant image data of a given facsimile 
f ormat. Further, the step S3 transfers the compression- 
resultant image data of the facsimile format from the da- 
ta compressor 8 to the storage unit 4 before storing the 
compression-resultant image data of the facsimile for- 
mat into the storage unit 4. In the case where the trans- 
mission of .information on a plurality of document sheets 
(that is, a plurality of pages) is required, the document 
sheets are sequentially scanned by the device 6 and the 
compression-resultant image data of the facsimile for- 
mat is stored into the storage unit 4 as a single file having 
a plurality of pages. 

[0065] A step S4 following the step S3 transfers the 
compression-resultant image data of the facsimile for- 
mat from the storage unit 4 to the format converter 5. 
The step S4 activates the format converter 5 so that the 
compression-resultant image data of the facsimile for- 
mat is converted by the device 5 into corresponding im- 
age data of the e-mail format. In addition, the step S4 
transfers the image data of the e-mail format from the 
format converter 5 to the storage unit 4 before storing 
the image data of the e-mail format into the storage unit 
4. 

[0066] A step S5 subsequent to the step S4 transfers 
the image data of the e-mail format from the storage unit 
4 to the LAN controller 9. The step S5 activates the LAN 
controller 9 so that the image data of the e-mail format 
is further transferred from the LAN controller 9 to the e- 
mail computer 9A. The image data of the e-mail format, 
that is, an e-mail, is transmitted from the e-mail compu- 
ter 9A to the destination via the e-mail network 9B. After 



the step S5, the current execution cycle of the program 
segment ends. 

[0067] The image data generated by the scanner 6 is 
of the binary type or the bi-level type. The compression- 

5 resultant image data of the facsimile format which is 
generated by the data compressor 8 is also of the binary 
type or the bi-level type. The format converter 5 succes- 
sively encodes pieces of the compression-resultant fac- 
simile image data into corresponding 7-bit character 

10 code words respectively. The 7-bit character code 
words compose text-encoded image data. Thus, the for- 
mat converter 5 changes the compression-resultant fac- 
simile image data into the corresponding text-encoded 
image data. The format converter 5 adds a header of a 

15 given format to the text-encoded image data, thereby 
completing the image data of the e-mail format. The 
header includes information of the destination, informa- 
tion of a source address, information of the data format, 
and information of the manner of conversion from the 

20 image data into the character code words. The format 
related to the header and the manner of conversion from 
the image data into the character code words are in con- 
formity with the Internet e-main standards referred to as 
MIME (Multipurpose Internet Mail Extensions). 

25 

Second Embodiment 

[0068] Fig. 3 shows a second embodiment of this in- 
vention which is similar to the embodiment of Figs. 1 
30 and 2 except for an additional arrangement described 
hereinafter. 

[0069] With reference to Fig. 3, an electronic mail sys- 
tem includes a CPU 1 , a ROM 2, a RAM 3, a storage 
unit 4, a format converter 5, a scanner 6, an operation 

35 panel 7, a data compressor/expander 8A, a LAN (local 
area network) controller 9, an inverse format converter 
1 0, and a printer 1 1 which are electrically connected via 
a bus line. The inverse format converter 1 0 changes im- 
age data of the e-mail format into corresponding image 

40 data of a given facsimile format. The data compressor/ 
expander 8A replaces the data compressor 8 in Fig. 1 . 
The data compressor/expander 8A serves to compress 
binary image data (bi-level image data) generated by 
the scanner6. In addition, the data compressor/expand- 

45 er 8A serves to expand image data of the facsimile for- 
mat into expansion-resultant binary image data (expan- 
sion-resultant bi-level image data). The printer 11 
serves to print out expansion-resultant binary image da- 
ta. 

so [0070] The CPU 1 operates in accordance with a pro- 
gram stored in the ROM 2. Fig. 4 is a flowchart of a seg- 
ment of the program . With reference to Fig. 4, a first step 
S1 1 in the program segment decides whether or not da- 
ta of the e-mail format has been received by the LAN 

55 controller 9. In the case where data of the e-mail format 
has been received, the step S11 transfers the received 
data of the e-mail format to the storage unit 4. The step 
S1 1 controls the storage unit 4 so that the received data 
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of the e-mail format is stored into the storage unit 4. In 
the case where data of the e-mail format has not yet 
been received, the program repeats the step S1 1 . Thus, 
the step S11 waits the reception of data of the e-mail 
format. 

[0071] A step S12A following the step S11 decides 
whether or not the received data of the e-mail format 
agrees with image data of the e-mail format by referring 
to related information in the header of the received data 
of the e-mail format. When the received data agrees with 
image data, the program advances from the step S12A 
to a step S12B. When the received data differs from im- 
age data, the program advances from the step S12A to 
a step S1 2C. The step S1 2B transfers the received data 
of the e-mail format from the storage unit 4 to the inverse 
format converter 10. The step S12B activates the in- 
verse format converter 10 so that the received data of 
the e-mail format is converted by the device 1 0 into cor- 
responding image data of a given facsimile format. The 
step 1 2C controls the LAN controller 9 so that a respon- 
sive e-mail representing an error will be transmitted to 
the source concerning the received data of the e-mail 
format. After the step S1 2C , the current execution cycle 
of the program segment ends. 
[0072] A step S1 3 following the step S1 2B transfers 
the image data of the facsimile format from the inverse 
format converter 10 to the data compressor/expander 
8A. The step S13 activates the data compressor/ex- 
pander 8A so that the image data of the facsimile format 
is expanded by the device 8A into expansion-resultant 
binary image data (expansion-resultant bi-level image 
data). Further, the step S13 transfers the expansion-re- 
sultant binary image data from the data compressor/ex- 
pander 8A to the storage unit 4 before storing the ex- 
pansion-resultant binary image data into the storage 
unit 4. 

[0073] A step S1 4 subsequent to the step S1 3 trans- 
fers the expansion-resultant binary image data from the 
storage unit 4 to the printer 11 . The step S14 activates 
the printer 11 so that the expansion-resultant binary im- 
age data is visualized or printed out by the device 11 . 
After the step S14, the current execution cycle of the 
program segment ends. 

[0074] As previously described, the inverse format 
converter 1 0 changes the received data of the e-mail 
format into the corresponding image data of the facsim- 
ile format. Specifically, the inverse format converter 10 
extracts text-encoded image data from the received da- 
ta of the e-mail format. Then, the inverse format con- 
verter 1 0 changes the text-encoded image data into cor- 
responding binary (bi-level) image data of the facsimile 
format. 

Third Embodiment 

[0075] Fig. 5 shows a third embodiment of this inven- 
tion which is similar to the embodiment of Figs. 3 and 4 
except for an additional arrangement described herein- 



after. 

[0076] With reference to Fig. 5, an electronic mail sys- 
tem includes a CPU 1 , a ROM 2, a RAM 3, a storage 
unit 4, a format converter 5, a scanner 6, an operation 

5 panel 7, a data compressor/expander 8A, a LAN (local 
area network) controller 9, an inverse format converter 
10, a printer 11 , and a font memory 12 which are elec- 
trically connected via a bus line. The font memory 12 
includes, for example, a ROM which stores font data 

10 providing the relation between character code data and 
image data. 

[0077] The CPU 1 operates in accordance with a pro- 
gram stored in the ROM 2. Fig. 6 is a flowchart of a seg- 
ment of the program. With reference to Fig. 6, afirststep 

15 S21 in the program segment decides whether or not da- 
ta of the e-mail format has been received by the LAN 
controller 9. This decision is to wait the reception of data 
of the e-mail format. In the case where data of the e- 
mail format has been received, the step S21 decides 

20 whether or not the received data of the e-mail format 
agrees with character code data by referring to the data 
format information in the header of the received data of 
the e-mail format. According to the MIME standards, the 
data format information follows the information "content- 

25 type" , and denotes "text/plain" in the case where the re- 
lated data of the e-mail format agrees with character 
code data. It should be noted that the data format infor- 
mation denotes "image/tiff in the case where the related 
data of the e-mail format agrees with image data. When 

30 the received data of the e-mail format agrees with char- 
acter code data, the program advances from the step 
S21 to a step S22B. When the received data of the e- 
maii format agrees with image data, the received data 
of the e-mail format will be processed as in the embod- 

35 iment of Figs. 3 and 4. 

[0078] The step S22B activates the font memory 12 
so that the character code data is converted into corre- 
sponding image data according to the font data in the 
font memory 12. 

40 [0079] A step S23 following the step S22B transfers 
the image data to the printer 11 . Also, the step S23 ac- 
tivates the printer 1 1 so that the image data is visualized 
or printed out by the device 11 . After the step S23, the 
current execution cycle of the program segment ends. 

45 

Fourth Embodiment 

[0080] Fig. 7 shows a fourth embodiment of this in- 
vention which is similar to the embodiment of Figs. 5 
50 and 6 except for an additional arrangement described 
hereinafter. 

[0081 ] With reference to Fig. 7, an electronic mail sys- 
tem includes a CPU 1 , a ROM 2, a RAM 3, a storage 
unit 4, a format converter 5, a scanner 6, an operation 
55 panel 7, a data compressor/expander 8A, a LAN (local 
area network) controller 9, an inverse format converter 
1 0, a printer 1 1 , a font memory 1 2, and a character rec- 
ognition unit 13 which are electrically connected via a 
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bus line. The character recognition unit 1 3 serves to rec- 
ognize characters represented by binary image data (bi- 
level image data). 

[0082] Information on a document sheet which is to 
be transmitted contains information of the destination or 5 
the address of a transmitted e-mail. Specifically, char- 
acters in a predetermined zone of the document sheet 
indicate an e-mail destination. Thus, the characters in 
the predetermined zone of the document sheet corre- 
spond to the information of the e-mail destination. 
[0083] The CPU 1 operates in accordance with a pro- 
gram stored in the ROM 2. Fig. 8 is a flowchart of a seg- 
ment of the program. With reference to Fig. 8, a first step 
S31 in the program segment decides whether or not a 
start button on the operation panel 7 has been de- 
pressed. In the case where the start button on the op- 
eration panel 7 has been depressed, the program ad- 
vances from the step S31 to a step S32. Otherwise, the 
program repeats the step S31 . Thus, the step S31 waits 
the depression of the start button. 
[0084] The step S32 activates the scanner 6 so that 
an image of the surface of a document sheet i n the scan- 
ner 6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bi-level image data). 
[0085] A step S33 following the step S32 extracts a 
portion of the binary image data which corresponds to 
the predetermined zone. The step S33 transfers the ex- 
tracted portion of the image data to the character rec- 
ognition unit 1 3. Further, the step S33 activates the char- 
acter recognition unit 1 3 so that characters represented 
by the extracted portion of the image data are recog- 
nized by the device 13. The character recognition unit 
13 generates information of a destination in accordance 
with the result of the character recognition. 
[0086] A step S34 subsequent to the step S33 trans- 
fers the binary image data from the scanner 6 to the data 
compressor/expander 8A. Then, the step S34 activates 
the data compressor/expander 8A so that the binary im- 
age data is compressed by the device 8A into compres- 
sion-resultant image data of a given facsimile format. 
Further, the step S34 transfers the compression-result- 
ant image data of the facsimile format from the data 
compressor/expander 8A to the storage unit 4 before 
storing the compression-resultant image data of the fac- 
simile format into the storage unit 4. 
[0087] A step S35 following the step S34 transfers the 
compression-resultant image data of the facsimile for- 
mat from the storage unit 4 to the format converter 5. In 
addition, the step S35 transfers the information of the 
destination to the format converter 5. The step S35 ac- 
tivates the format converter 5 so that the compression- 
resultant image data of the facsimile format is converted 
by the device 5 into corresponding image data of the e- 
mail format. The image data of the e-mail format con- 
tains the information of the destination. Further, the step 
S35 transfers the image data of the e-mail format from 
the format converter 5 to the storage unit 4 before stor- 
ing the image data of the e-mail format into the storage 
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unit 4. 

[0088] A step S36 subsequent to the step S35 trans- 
fers the image data of the e-mail format from the storage 
unit 4 to the LAN controller 9. The step S36 activates 
the LAN controller 9 so that the image data of the e-mail 
format is further transferred from the LAN controller 9 to 
an e-mail computer 9A. The image data of the e-mail 
format, that is, an e-mail, is transmitted from the e-mail 
computer 9A to the destination via an e-mail network 
9B. After the step S36, the current execution cycle of 
the program segment ends. 

Fifth Embodiment 

[0089] Fig. 9 shows a fifth embodiment of this inven- 
tion which is similar to the embodiment of Figs. 1 and 2 
except for an additional arrangement described herein- 
after. 

[0090] With reference to Fig . 9, an electronic mail sys- 
tem includes a CPU 1 , a ROM 2, a RAM 3, a storage 
unit 4, a format converter 5, a scanner 6, an operation 
panel 7A, a data compressor 8, and a LAN (local area 
network) controller 9 which are electrically connected 
via a bus line. The operation panel 7A replaces the op- 
eration panel 7 in Fig. 1 . The operation panel 7A has a 
keyboard, a start button, a source button, and other but- 
tons. Information of the destination or the address of an 
e-mail to be transmitted can be inputted into the elec- 
tronic mail system by operating the key board on the 
operation panel 7A. The scanner 6 can be activated by 
operating the start button on the operation panel 7A. In- 
formation of the address of an e-mail transmission 
source can be inputted into the electronic mail system 
by operating the source button on the operation panel 
7A. The source address agrees with an address as- 
signed to an e-mail computer 9A connected to the LAN 
controller 9. Accordingly, in the event that the transmis- 
sion of an e-mail from the electronic mail system to the 
destination has failed, a responsive e-mail representing 
the transmission failure can be received by the e-mail 
computer 9A. 

[0091 ] The CPU 1 operates in accordance with a pro- 
gram stored in the ROM 2. Fig. 10 is a flowchart of a 
segment of the program. With reference to Fig. 10, a 
first step S41 in the program segment decides whether 
or not information of the destination or the address of 
an e-mail to be transmitted has been inputted via the 
operation panel 7A. In the case where the information 
of the destination of an e-mail to be transmitted has been 
inputted, the program advances from the step S41 to a 
step S42. Otherwise, the program repeats the step S41 . 
Thus, the step S41 waits the reception of the information 
of an e-mail destination. 

[0092] The step S42 decides whether or not the 
source button on the operation panel 7A has been de- 
pressed to input the information of the address of the e- 
mail transmission source. In the case where the source 
button on the operation panel 7A has been depressed, 
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the program advances from the step S42 to a step S43. 
Otherwise, the program repeats the step S42. Thus, the 
step S42 waits the reception of the information of an e- 
mail source address. 

[0093] The step S43 decides whether or not the start 
button on the operation panel 7A has been depressed. 
In the case where the start button on the operation panel 
7 A has been depressed, the program advances from the 
step S43 to a step S44. Otherwise, the program repeats 
the step S43. Thus, the step S43 waits the depression 
of the start button. 

[0094] The step S44 activates the scanner 6 so that 
an image of the surface of a document sheet in the scan- 
ner 6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bi-level image data). 
A step S45 following the step S44 transfers the binary 
image data from the scanner 6 to the data compressor 
8. Then, the step S45 activates the data compressor 8 
so that the binary image data is compressed by the de- 
vice 8 into compression-resultant image data of a given 
facsimile format. Further, the step S45 transfers the 
compression-resultant image data of the facsimile for- 
mat from the data compressor 8 to the storage unit 4 
before storing the compression-resultant image data of 
the facsimile format into the storage unit 4. 
[0095] A step S46 following the step S45 transfers the 
compression-resultant image data of the facsimile for- 
mat from the storage unit 4 to the format converter 5. In 
addition, the step S46 transfers the information of the 
source address and the information of the destination to 
the format converter 5. The step S46 activates the for- 
mat converter 5 so that the compression-resultant im- 
age data of the facsimile format is converted by the de- 
vice 5 into corresponding image data of the e-mail for- 
mat. The image data of the e-mail format contains the 
information of the source address and the information 
of the destination. Further, the step S46 transfers the 
image data of the e-mail format from the format convert- 
er 5 to the storage unit 4 before storing the image data 
of the e-mail format into the storage unit 4. 
[0096] A step S47 subsequent to the step S46 trans- 
fers the image data of the e-mail format from the storage 
unit 4 to the LAN controller 9. The step S47 activates 
the LAN controller 9 so that the image data of the e-mail 
format is further transferred from the LAN controller 9 to 
the e-mail computer 9A. The image data of the e-mail 
format, that is, an e-mail, is transmitted from the e-mail 
computer 9A to the destination via an e-mail network 
9B. After the step S47, the current execution cycle of 
the program segment ends. 

Sixth Embodiment 

[0097] Fig. 11 shows a sixth embodiment of this in- 
vention which is similar to the embodiment of Figs. 7 
and 8 except for an additional arrangement described 
hereinafter. 

[0098] With reference to Fig. 11, an electronic mail 
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system includes a CPU 1 , a ROM 2, a RAM 3, a storage 
unit 4, a format converter 5, a scanner 6, an operation 
panel 7B, a data compressor/expander 8A, a LAN (local 
area network) controller 9, an inverse format converter 
5 1 0, a printer 1 1 , a font memory 1 2, a character recogni- 
tion unit 13. an audio input/output device 14, and an au- 
dio compressor/expander 15 which are electrically con- 
nected via a bus line. The operation panel 7B replaces 
the operation panel 7 in Fig. 7. The operation panel 7B 
io has a start button, a message button, and other buttons. 
The scanner 6 can be activated by operating the start 
button on the operation panel 7B. The depression of the 
message button on the operation panel 7B enables au- 
dio message information to be inputted into the electron- 
's ic mail system. The audio input/output device 14 in- 
cludes a microphone and an electric-to-sound transduc- 
er such as a loudspeaker (a sound speaker). The mi- 
crophone in the audio input/output device 14 converts 
a sound message into a corresponding audio signal. 
20 The audio signal is changed into corresponding audio 
data by an A/D converter in the audio input/output de- 
vice 14. The audio input/output device 14 also includes 
a D/A converter which changes audio data into a corre- 
sponding audio signal. The audio signal is converted in- 
25 to corresponding sound by the loudspeaker (the sound 
speaker) in the audio input/output device 14. The audio 
compressor/expander 15 serves to compress and ex- 
pand audio data. 

[0099] The CPU 1 operates in accordance with a pro- 

30 gram stored in the ROM 2. Fig. 1 2 is a flowchart of a first 
segment of the program. With reference to Fig. 12, a 
first step S51 in the first program segment decides 
whether or not the start button on the operation panel 
7B has been depressed. In the case where the start but- 

35 ton on the operation panel 7B has been depressed, the 
program advances from the step S51 to a step S52. Oth- 
erwise, the program repeats the step S51 .Thus, the 
step S51 waits the depression of the start button. 
[01 00] The step S52 decides whether or not the mes- 

40 sage button on the operation panel 7B is depressed and 
a sound message is converted by the microphone and 
the A/D converter in the audio input/output device 14 
into corresponding audio data. This decision is to wait 
the depression of the message button and the reception 

45 of the audio data. I n the case where the message button 
on the operation panel 7B is depressed and the sound 
message is converted by the audio input/output device 
14 into the corresponding audio data, the step S52 
transfers the audio data from the audio input/output de- 

50 vice 1 4 to the audio compressor/expander 1 5. The step 
S52 activates the audio compressor/expander 15 so 
that the audio data is compressed by the device 15 into 
compression-resultant audio data. Further, the step S52 
transfers the compression-resultant audio data from the 

55 audio compressor/expander 1 5 to the storage u nit 4 be- 
fore storing the compression-resultant audio data into 
the storage unit 4. 

[0101] A step S53 subsequent to the step S52 acti- 
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vates the scanner 6 so that an image of the surface of 
a document sheet in the scanner 6 is converted by the 
scanner 6 into corresponding binary image data (corre- 
sponding bi-level image data). 
[0102] A step S54 following the step S53 extracts a 
portion of the binary image data which corresponds to 
a predetermined zone. The step S54 transfers the ex- 
tracted portion of the image data to the character rec- 
ognition unit 13. Further, the step S54 activates the char- 
acter recognition unit 13 so that characters represented 
by the extracted portion of the image data are recog- 
nized by the device 13. The character recognition unit 
13 generates information of a destination in accordance 
with the result of the character recognition. 
[01 03] A step S55 subsequent to the step S54 trans- 
fers the binary image data from the scanner 6 to the data 
compressor/expander 8A. Then, the step S55 activates 
the data compressor/expander 8A so that the binary im- 
age data is compressed by the device 8A into compres- 
sion-resultant image data of a given facsimile format. 
Further, the step S55 transfers the compression-result- 
ant image data of the facsimile format from the data 
compressor/expander 8A to the storage unit 4 before 
storing the compression-resultant image data of the fac- 
simile format into the storage unit 4. 
[01 04] A step S56 following the step S55 transfers the 
compression-resultant image data of the facsimile for- 
mat from the storage unit 4 to the format converter 5. In 
addition, the step S56 transfers the information of the 
destination to the format converter 5. Further, the step 
S56 transmits the compression-resultant audio data 
from the storage unit 4 to the format converter 5. The 
step S56 activates the format converter 5 so that the 
compression-resultant image data of the facsimile for- 
mat and the compression-resultant audio data are con- 
verted and integrated by the device 5 into corresponding 
image/audio data of the e-mail format. It should be noted 
that the manner of the integration is in conformity with 
the MIME standards. The image/audio data of the e-mail 
format contains the information of the destination. Fur- 
ther, the step S56 transfers the image/audio data of the 
e-mail format from the format converter 5 to the storage 
unit 4 before storing the image/audio data of the e-mail 
format into the storage unit 4. 

[01 05] A step S57 subsequent to the step S56 trans- 
fers the image/audio data of the e-mail format from the 
storage unit 4 to the LAN controller 9. The step S57 ac- 
tivates the LAN controller 9 so that the image/audio data 
of the e-mail format is further transferred from the LAN 
controller 9 to an e-mail computer 9A. The image/audio 
data of the e-mail format, that is, an e-mail, is transmit- 
ted from the e-mail computer 9A to the destination via 
an e-mail network 9B. After the step S57, the current 
execution cycle of the first program segment ends. 
[0106] Fig. 13 is a flowchart of a second segment of 
the program. With reference to Fig. 1 3, a first step S58A 
in the second program segment decides whether or not 
data of the e-mail format has been received by the LAN 



controller 9. This decision is to wait the reception of data 
of the e-mail format. In the case where data of the e- 
mail format has been received, the step S58A transfers 
the received data of the e-mail format to the storage unit 
5 4. The step S58A controls the storage unit 4 so that the 
received data of the e-mail format is stored into the stor- 
age unit 4. 

[01 07] A step S58B following the step S58 A transfers 
the received data of the e-mail format from the storage 

io unit 4 to the inverse format converter 1 0. A step S58C 
subsequent to the step S58B decides whether or not the 
received data of the e-mail format agrees with image/ 
audio data of the e-mail format by referring to related 
information in the header of the received data of the e- 

15 mail format. When the received data agrees with image/ 
audio data, the step S58C activates the inverse format 
converter 1 0 so that the received data of the e-mail for- 
mat is converted and separated by the device 10 into 
image data of a given facsimile format and audio data. 

20 When the received data differs from image/audio data, 
the received data will be processed as in the embodi- 
ment of Figs. 3 and 4. 

[01 08] A step S58D following the step S58C transfers 
the image data of the facsimile format from the inverse 

25 format converter 10 to the data compressor/expander 
8A. The step S58D activates the data compressor/ex- 
pander 8A so that the image data of the facsimile format 
is expanded by the device 8A into expansion-resultant 
binary image data (expansion-resultant bi-level image 

30 data). Further, the step S58D transfers the expansion- 
resultant binary image data from the data compressor/ 
expander 8A to the storage unit 4 before storing the ex- 
pansion-resultant binary image data into the storage 
unit 4. 

35 [0109] A step S58E subsequent to the step S58D 
transfers the expansion-resultant binary image data 
from the storage unit 4 to the printer 1 1 . The step S58E 
activates the printer 11 so that the expansion-resultant 
binary image data is visualized or printed out by the de- 

40 vice 11. 

[01 10] A step S58F following the step S58E transfers 
the audio data from the inverse format converter 10 to 
the audio compressor/expander 15. The step S58F ac- 
tivates the audio compressor/expander 15 so that the 

45 audio data is expanded by the device 1 5 into expansion- 
resultant audio data. Further, the step S58F transfers 
the expansion-resultant audio data from the audio com- 
pressor/expander 1 5 to the storage unit 4 before storing 
the expansion-resultant audio data into the storage unit 

50 4. 

[0111] A step S58G subsequent to the step S58F 
transfers the expansion-resultant audio data from the 
storage unit 4 to the audio input/output device 14. The 
step S58G activates the audio input/output device 1 4 so 
55 that the loudspeaker (the sound speaker) and the D/A 
converter therein generate sound in response to the au- 
dio data. After the step S58G, the current execution cy- 
cle of the second program segment ends. 



4 



\ 



17 



EP1 139 645 A2 



Seventh Embodiment 

[0112] Fig. 14 shows a seventh embodiment of this 
invention which is similar to the embodiment of Figs. 
11-13 except for an additional arrangement described 
hereinafter. 

[0113] With reference to Fig. 14, an electronic mail 
system includes a CPU 1 , a ROM 2, a RAM 3, a storage 
unit 4, a format converter 5, a scanner 6, an operation 
panel 7C, a data compressor/expander 8A, a LAN (local 
area network) controller 9, an inverse format converter 

10, a printer 11 , a font memory 12, a character recogni- 
tion unit 13, an audio input/output device 14, an audio 
compressor/expander 15, a video input/output device 
16, and a moving-picture compressor/expander 17 
which are electrically connected via a bus line. The op- 
eration panel 7C replaces the operation pane! 7B in Fig. 

11 . The operation panel 7C has a start button, a video 
button, and other buttons. The scanner 6 can be acti- 
vated by operating the start button on the operation pan- 
el 7C. The depression of the video button on the oper- 
ation panel 7C enables moving-picture information to be 
inputted into the electronic mail system . The video input/ 
output device 1 6 includes a video camera and a display 
such as a CRT The video camera in the video input/ 
output device 16 converts moving pictures into corre- 
sponding data. The display in the video input/output de- 
vice 1 6 visualizes moving-picture data. The moving-pic- 
ture compressor/expander 17 serves to compress and 
expand moving-picture data. 

[01 1 4] The CPU 1 operates in accordance with a pro- 
gram stored in the ROM 2. Fig. 15 is a flowchart of a 
segment of the program. With reference to Fig. 15, a 
first step S61 in the program segment decides whether 
or not the start button on the operation panel 7C has 
been depressed. In the case where the start button on 
the operation panel 7C has been depressed, the pro- 
gram advances from the step S61 to a step S62. Other- 
wise, the program repeats the step S61 . Thus, the step 
S61 warts the depression of the start button. 
[01 15] The step S62 decides whether or not the video 
button on the operation panel 7C is depressed and mov- 
ing pictures are converted by the video camera in the 
video input/output device 16 into corresponding data. 
This decision is to wait the depression of the video but- 
ton and the reception of moving-picture data. In the case 
where the video button on the operation panel 7C is de- 
pressed and the moving pictures are converted by the 
video camera in the video input/output device 16 into 
the corresponding data, the step S62 transfers the mov- 
ing-picture data from the video input/output device 16 
to the moving-picture compressor/expander 17. The 
step S62 activates the moving-picture compressor/ex- 
pander 17 so that the moving-picture data is com- 
pressed by the device 17 into compression-resultant 
moving-picture data. Further, the step S62 transfers the 
compression- resultant moving-picture data from the 
moving-picture compressor/expander 1 7 to the storage 
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unit 4 before storing the compression-resultant moving- 
picture data into the storage unit 4. 
[0116] A step S63 subsequent to the step S62 acti- 
vates the scanner 6 so that an image of the surface of 
5 a document sheet in the scanner 6 is converted by the 
scanner 6 into corresponding binary image data (corre- 
sponding bi-level image data). 

[0117] A step S64 following the step S63 extracts a 
portion of the binary image data which corresponds to 

10 a predetermined zone. The step S64 transfers the ex- 
tracted portion of the image data to the character rec- 
ognition unit 13. Further, the step S64 activates the char- 
acter recognition unit 13 so that characters represented 
by the extracted portion of the image data are recog- 

15 nized by the device 13. The character recognition unit 
1 3 generates information of a destination in accordance 
with the result of the character recognition. 
[01 18] A step S65 subsequent to the step S64 trans- 
fers the binary image data from the scanner 6 to the data 

20 compressor/expander 8A. Then, the step S65 activates 
the data compressor/expander 8A so that the binary im- 
age data is compressed by the device 8A into compres- 
sion-resultant image data of a given facsimile format. 
Further, the step S65 transfers the compression-result- 

25 ant image data of the facsimile format from the data 
compressor/expander 8A to the storage unit 4 before 
storing the compression-resultant image data of the fac- 
simile format into the storage unit 4. 
[0119] A step S66 following the step S65 transfers the 

30 compression-resultant image data of the facsimile for- 
mat from the storage unit 4 to the format converter 5. In 
addition, the step S66 transfers the information of the 
destination to the format converter 5. Further, the step 
S66 transmits the compression-resultant moving-pic- 

35 ture data from the storage unit 4 to the format converter 
5. The step S66 activates the format converter 5 so that 
the compression-resultant image data of the facsimile 
format and the compression-resultant moving-picture 
data ware converted and integrated by the device 5 into 

40 corresponding image data of the e-mail format. It should 
be noted that the manner of the integration is in con- 
formity with the MIME standards. The image data of the 
e-mail format contains the information of the destination. 
Further, the step S66 transfers the image data of the e- 

45 mail format from the format converter 5 to the storage 
unit 4 before storing the image data of the e-mail format 
into the storage unit 4. 

[01 20] A step S67 subsequent to the step S66 trans- 
fers the image data of the e-mail format from the storage 

so unit 4 to the LAN controller 9. The step S67 activates 
the LAN controller 9 so that the image data of the e-mail 
format is further transferred from the LAN controller 9 to 
an e-mail computer 9A. Trie image data of the e-mail 
format, that is, an e-mail, is transmitted from the e-mail 

55 computer 9A to the destination via an e-mail network 
9B. After the step S67, the current execution cycle of 
the program segment ends. 
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Eighth Embodiment 

[01 21 ] Fig. 1 6 shows an eighth embodiment of this in- 
vention which is similar to the embodiment of Figs. 7 
and 8 except for design changes described hereinafter. 
[0122] With reference to Fig. 16, an electronic mail 
system includes a CPU 1 , a ROM 2, a RAM 3, a storage 
unit 4, a format converter 5, a scanner 6, an operation 
panel 7, a data compressor/expander 8A, a LAN (local 
area network) controller 9X, an inverse format converter 
10, a printer 11 , a font memory 12, and a character rec- 
ognition unit 13 which are electrically connected via a 
bus line. The LAN controller 9X replaces the LAN con- 
troller 9 in Fig. 7. The LAN controller 9X analyzes a re- 
ceived e-mail. The CPU 1 is programmed to execute da- 
ta processing in response to a result of the analysis by 
the LAN controller 9X. 

[0123] Fig. 17 shows a part of an example of an e- 
mail in a given format. As shown in Fig. 17, the e-mail 
has a header 31 and a text (a message) 32. The header 

31 is followed by the text 32. The header 31 contains 
information representing a type of data in the text 32. In 
the example of Fig. 1 7, "Content-Type : text/plain" in the 
header 31 represents that a related portion of the text 

32 corresponds to character code data. Further, 
"Subject : !!$" in the header 31 represents that a related 
portion of the text 32 corresponds to an instruction (a 
command). 

[01 24] The text 32 contains ID (identification) informa- 
tion of a sender, information of a list of destination mail 
addresses, and information of a source address. The ID 
information of the sender is preceded by a specified 
code word "!ID B . The information of the list of the desti- 
nation mail addresses is preceded by a specified code 
word "ILIST". The information of the source address is 
preceded by a specified code word "FROM". 
[0125] After the LAN controller 9 receives an e-mail, 
the LAN controller 9 analyzes ID (identification) informa- 
tion of a sender, information of a list of destination mail 
addresses, and information of a source address which 
are contained in the received e-mail. The LAN controller 
9 recognizes the sender as a result of the analysis of 
the ID information thereof. The CPU 1 serves to transfer 
the ID information of the sender, the information of the 
list of the destination mail addresses, and the informa- 
tion of the source address from the LAN controller 9 to 
the storage unit 4. Then, the CPU 1 serves to store the 
ID information of the sender, the information of the list 
of the destination mail addresses, and the information 
of the source address into the storage unit 4. 

Ninth Embodiment 

[0126] Fig. 18 shows a ninth embodiment of this in- 
vention which is similar to the embodiment of Figs. 7 
and 8 except for design changes described hereinafter. 
[0127] With reference to Fig. 18, an electronic mail 
system includes a CPU 1 , a ROM 2, a RAM 3, a storage 
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unit 4, a format converter 5, a scanner 6, an operation 
panel 7D, a data compressor/expander 8A, a LAN (local 
area network) controller 9, an inverse format converter 
1 0, a printer 1 1 , a font memory 1 2, and a character rec- 
5 ognition unit 13 which are electrically connected via a 
bus line. The operation panel 7D replaces the operation 
panel 7 in Fig. 7. The operation panel 7D has a display, 
a key board, a start button, a destination list button, and 
other buttons. Information of a destination list can be 

10 visualized by the display on the operation panel 7D. ID 
information of a sender can be inputted into the elec- 
tronic mail system by operating the key board on the 
operation panel 7D. The scanner 6 can be activated by 
operating the start button on the operation panel 7D. 

is The depression of the destination list button on the op- 
eration panel 7D enables a destination list to be indicat- 
ed by display on the operation panel 7D. 
[01 28] The CPU 1 operates in accordance with a pro- 
gram stored in the ROM 2. Fig. 1 9 is a flowchart of a first 

20 segment of the program. With reference to Fig. 19, a 
first step S71 in the first program segment decides 
whether or not character code data in an e-mail has 
been received bythe LAN controller9. In the case where 
the character code data in the e-mail has been received, 

25 the program advances from the step S71 to a step S72. 
Otherwise, the program repeats the step S71 . Thus, the 
step S71 waits the reception of character code data in 
an e-mail. The step S72 analyzes the "Subject" part of 
the header of the e-mail. 

30 [0129] A step S73 following the step S72 decides 
whether or not the "Subject" part of the header corre- 
sponds to a text instruction by referring to the result of 
the analysis by the step S72. When the "Subject" part 
of the header corresponds to a text instruction, the pro- 

35 gram advances from the step S73 to a step S74. Other- 
wise, the program advances from the step S73 to a step 
S76. 

[01 30] The step S74 analyzes the text in the e-mail to 
extract ID information of a sender and information of a 

40 destination mail list therefrom. A step S75 following the 
step S74 stores or registers the ID information of the 
sender and the information of the destination mail list 
into the storage unit 4 in a manner such that the ID in- 
formation of the sender and the information of the des- 

45 tination mail list are in a given correspondence relation. 
After the step S75, the current execution cycle of the 
first program segment ends. 

[01 31 ] The step S76 converts character code data in 
the text into corresponding image data. A step S77 fol- 

50 lowing the step S76 transfers the image data to the print- 
er 1 1 . The step S77 activates the printer 1 1 so that the 
image data is visualized or printed out by the device 1 1 . 
After the step S77, the current execution cyde of the 
first program segment ends. 

55 [0132] Fig. 20 is a flowchart of a second segment of 
the program. With reference to Fig. 20, a first step S81 
of the second program segment decides whether or not 
the destination list button on the operation panel 7D has 
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been depressed. In the case where the destination list 
button on the operation panel 7D has been depressed, 
the program advances from the step S81 to a step S82. 
Otherwise, the program repeats the step S81 . Thus, the 
step S82 waits the depression of the destination list but- 
ton. 

[0133] The step S82 decides whether or not ID infor- 
mation of a sender has been inputted via the operation 
panel 7D. This decision is to waitthe reception of sender 
ID information. In the case where the ID information of 
the sender has been inputted, the step S82 reads out 
information of a destination mail list from the storage unit 
4 which corresponds to the ID information of the sender. 
The step S82 transfers the information of the destination 
mail list to the display on the operation panel 7D. The 
step S82 activates the display on the operation panel 
7D so that the information of the destination mail list is 
visualized thereby. 

[0134] A step S83 following the step S82 decides 
whether or not a destination has been selected from the 
visualized destination mail list by actuating the operation 
panel 7D. In the case where a destination has been se- 
lected, the program advances from the step S83 to a 
step S84. Otherwise, the program repeats the step S83. 
Thus, the step S83 waits the selection of a destination. 
[01 35] The step S84 decides whether or not the start 
button on the operation panel 7D has been depressed. 
I n the case where the start button on the operation panel 
7D has been depressed, the program advances from 
the step S84 to a step S85. Otherwise, the program re- 
peats the step S84. Thus, the step S84 waits the de- 
pression of the start button. 

[0136] The step S85 activates the scanner 6 so that 
an image of the surface of a document sheet in the scan- 
ner 6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bi-level image data). 
[01 37] A step S86 subsequent to the step S85 trans- 
fers the binary image data from the scanner 6 to the data 
compressor/expander 8A. Then, the step S86 activates 
the data compressor/expander 8A so that the binary im- 
age data is compressed by the device 8A into compres- 
sion-resultant image data of a given facsimile format. 
Further, the step S86 transfers the compression-result- 
ant image data of the facsimile format from the data 
compressor/expander 8A to the storage unit 4 before 
storing the compression-resultant image data of the fac- 
simile format into the storage unit 4. 
[0138] A step S87 following thestep S86 transfers the 
compression-resultant image data of the facsimile for- 
mat from the storage unit 4 to the format converter 5. In 
addition, the step S87 informs the format converter 5 of 
the selected destination. The step S87 activates the for- 
mat converter 5 so that the compression-resultant im- 
age data of the facsimile format is converted by the de- 
vice 5 into corresponding image data of the e-mail for- 
mat. The image data of the e-mail format contains the 
information of the destination. Further, the step S87 
transfers the image data of the e-mail format from the 
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format converter 5 to the storage unit 4 before storing 
the image data of the e-mail format into the storage unit 
4. 

[01 39] A step S88 subsequent to the step S87 trans- 
5 fers the image data of the e-mail format from the storage 
unit 4 to the LAN controller 9. The step S88 activates 
the LAN controller 9 so that the image data of the e-mail 
format is further transferred from the LAN controller 9 to 
an e-mail computer 9A. The image data of the e-mail 
10 format, that is, an e-mail, is transmitted from the e-mail 
computer 9A to the selected destination via an e-mail 
network 9B. After the step S88, the current execution 
cycle of the second program segment ends. 

is Tenth Embodiment 

[0140] Fig. 21 shows a tenth embodiment of this in- 
vention which is similar to the embodiment of Figs. 
18-20 except for design changes described hereinafter. 

20 [0141] With reference to Fig. 21, an electronic mail 
system includes a CPU 1 , a ROM 2, a RAM 3, a storage 
unit 4, a format converter 5, a scanner 6, an operation 
panel 7E, a data compressor/expander 8A, a LAN (local 
area network) controller 9, an inverse format converter 

25 1 o, a printer 1 1 , a font memory 1 2, and a character rec- 
ognition unit 13 which are electrically connected via a 
bus line. The operation panel 7E replaces the operation 
panel 7D in Fig. 18. The operation panel 7E has a dis- 
play, a key board, a start button, a source button, and 

30 other buttons. Information of a source address can be 
visualized by the display on the operation panel 7E. In- 
formation of the destination or the address of an e-mail 
to be transmitted can be inputted into the electronic mail 
system by operating the key board on the operation pan- 

35 el 7E. ID information of a sender can be inputted into 
the electronic mail system by operating the source but- 
ton on the operation panel 7E. The scanner 6 can be 
activated by operating the start button on the operation 
panel 7E. 

40 [01 42] The CPU 1 operates in accordance with a pro- 
gram stored in the ROM 2. Fig. 22 is a flowchart of a first 
segment of the program. With reference to Fig. 22, a 
first step S71A in the first program segment decides 
whether or not character code data in an e-mail has 

45 been received by the LAN controller 9. In the case where 
the character code data in the e-mail has been received, 
the program advances from the step S71A to a step 
S72A. Otherwise, the program repeats the step S71 A. 
Thus, the step S71A waits the reception of character 

so code data in an e-mail. The step S72A analyzes the 
"Subject" part of the header of the e-mail. 
[01 43] A step S73A following the step S72A decides 
whether or not the "Subject" part of the header corre- 
sponds to a text instruction by referring to the result of 

55 the analysis by the step S72A. When the "Subject" part 
of the header corresponds to a text instruction, the pro- 
gram advances from the step S73A to a step S74A. Oth- 
erwise, the program advances from the step S73A to a 
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step S76A. 

[01 44] The step S74A analyzes the text in the e-mail 
to extract ID information of a sender and information of 
a source address therefrom. A step S75A following the 
step S74A stores or registers the ID information of the 
sender and the information of the source address into 
the storage unit 4 in a manner such that the ID informa- 
tion of the sender and the information of the source ad- 
dress are in a given correspondence relation. After the 
step S75A, the current execution cycle of the first pro- 
gram segment ends. 

[0145] The step S76A converts character code data 
in the text into corresponding image data. A step S77A 
following the step S76A transfers the image data to the 
printer 1 1 . The step S77A activates the printer 1 1 so that 
the image data is visualized or printed out by the device 
11. After the step S77A, the current execution cycle of 
the first program segment ends. 
[0146] Fig. 23 is a flowchart of a second segment of 
the program. With reference to Fig. 23, a first step S82A 
of the second program segment decides whether or not 
ID information of a sender has been inputted by de- 
pressing the source button on the operation panel 7E. 
This decision is to wait the reception of sender ID infor- 
mation. In the case where the ID information of the sen ti- 
er has been inputted, the step SB2A reads out informa- 
tion of a source address from the storage unit 4 which 
corresponds to the ID information of the sender. The 
step S82A transfers the information of the source ad- 
dress to the display on the operation panel 7E. The step 
S82A activates the display on the operation panel 7E so 
that the information of the source address is visualized 
thereby. Thus, it is possible to confirm the source ad- 
dress. 

[01 47] A step S83A following the step S82A decides 
whether or not information of the destination or the ad- 
dress of an e-mail to be transmitted has been inputted 
via the operation panel 7E. In the case where the infor- 
mation of the destination of an e-mail to be transmitted 
has been inputted, the program advances from the step 
S83A to a step S84A. Otherwise, the program repeats 
the step S83A. Thus, the step S83A waits the reception 
of the information of the destination. 
[01 48] The step S84A decides whether or not the start 
button on the operation panel 7E has been depressed. 
In the case where the start button on the operation panel 
7E has been depressed, the program advances from the 
step S84A to a step S85A. Otherwise, the program re- 
peats the step S84A. Thus, the step S84A waits the de- 
pression of the start button. 

[01 49] The step S85A activates the scanner 6 so that 
an image of the surface of a document sheet in the scan- 
ner 6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bi-level image data). 
[0150] A step S86A subsequent to the step S85A 
transfers the binary image data from the scanner 6 to 
the data compressor/expander 8A. Then, the step S86A 
activates the data compressor/expander 8 A so that the 
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binary image data is compressed by the device 8A into 
compression-resultant image data of a given facsimile 
format. Further, the step S86A transfers the compres- 
sion-resultant image data of the facsimile format from 
5 the data compressor/expander 8A to the storage un it 4 
before storing the compression-resultant image data of 
the facsimile format into the storage unit 4. 
[01 51 ] A step S87A following the step S86A transfers 
the compression-resultant image data of the facsimile 

10 format from the storage unit 4 to the format converter 5. 
In addition, the step S87A transfers the information of 
the source address and the information of the destina- 
tion to the format converter 5. The step S87A activates 
the format converter 5 so that the compression-resultant 

15 image data of the facsimile format is converted by the 
device 5 into corresponding image data of the e-mail for- 
mat. The image data of the e-mail format contains the 
information of the source address and the information 
of the destination. Further, the step S87A transfers the 

20 image data of the e-mail format from the format convert- 
er 5 to the storage unit 4 before storing the image data 
of the e-mail format into the storage unit 4. 
[0152] A step S88A subsequent to the step S87A 
transfers the image data of the e-mail format from the 

25 storage unit 4 to the LAN controller 9. The step S88A 
activates the LAN controller 9 so that the image data of 
the e-mail format is further transferred from the LAN 
controller 9 to an e-mail computer 9 A. The image data 
of the e-mail format, that is, an e-mail, is transmitted 

30 from the e-mail computer 9A to the destination via an e- 
mail network 9B. After the step S88A, the current exe- 
cution cycle of the second program segment ends. 

Eleventh Embodiment 

35 

[0153] An eleventh embodiment of this invention is 
similar to the embodiment of Figs. 18-20 except for de- 
sign changes described hereinafter. 
[0154] In the eleventh embodiment, when ID informa- 
40 tion of a sender is inputted, a source address corre- 
sponding to the ID information of the sender is recog- 
nized. Information of the source address is automatical- 
ly written into the header of an e-mail carrying image 
data. 

45 

Twelfth Embodiment 

[01 55] Fig. 24 shows a twelfth embodiment of this in- 
vention which is similar to the embodiment of Figs. 14 

50 and 15 except for design changes described hereinafter. 
[0156] With reference to Fig. 24, an electronic mail 
system includes a CPU 1 , a ROM 2, a RAM 3, a storage 
unit 4, a format converter 5, a scanner 6, an operation 
panel 7F, a data compressor/expander 8A, a LAN (local 

55 area network) controller 9, an inverse format converter 
1 0, a printer 1 1 , a font memory 1 2, a character recogni- 
tion unit 13, an audio input/output device 14, an audio 
compressor/expander 15, a video input/output device 
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16, a moving-picture compressor/expander 17, and a 
modem 18 which are electrically connected via a bus 
line. The operation panel 7F replaces the operation pan- 
el 7C in Fig. 1 4. The operation panel 7F has a key board, 
a start button, a mode selection button, and other but- 
tons. Information of the destination or the address of an 
e-mail to be transmitted can be inputted into the elec- 
tronic mail system by operating the key board on the 
operation panel 7F. In addition, information of a destina- 
tion telephone number can be inputted into the electron- 
ic mail system by operating the key board on the oper- 
ation panel 7F. The scanner 6 can be activated by op- 
erating the start button on the operation panel 7F. Op- 
eration of the electronic mail system can be changed 
between an e-mail mode and a facsimile mode by op- 
erating the mode selection button on the operation panel 
7F. The modem 1 8 is connected to a telephone line. The 
modem 1 8 serves to transmit and receive a facsimile 
signal to and from the telephone line. 
[01 57] The CPU 1 operates in accordance with a pro- 
gram stored in the ROM 2. Fig. 25 is a flowchart of a 
segment of the program. With reference to Fig. 25, a 
first step S91 in the program segment decides whether 
or not the mode selection button on the operation panel 
7F has been operated. In the case where the mode se- 
lection button on the operation panel 7F has been op- 
erated, the program advances from the step S91 to a 
step S92. Otherwise, the program repeats the step S91 . 
Thus, the step S91 waits operation of the mode selec- 
tion button. 

[0158] The step S92 decides which of the e-mail 
mode and the facsimile mode has been selected by re- 
ferring to a signal coming from the mode selection but- 
ton on the operation panel 7F. When the facsimile mode 
has been selected, the program advances from the step 
S92 to a step S93. When the e-mail mode has been se- 
lected, the program advances from the step S92 to a 
step S96. 

[01 59] The step S93 decides whether or not inf orma- 
tion of a destination telephone number has been input- 
ted via the operation panel 7F. Also, the step S93 de- 
cides whether or not the start button on the operation 
panel 7F has been depressed. In the case where the 
information of the destination telephone number has 
been inputted and the start button on the operation pan- 
el 7F has been depressed, the program advances from 
the step S93 to a step S94. Otherwise, the program re- 
peats the step S93. Thus, the step S93 waits the recep- 
tion of information of a destination telephone number 
and the depression of the start button. 
[0160] The step S94 activates the scanner 6 so that 
an image of the surface of a document sheet in the scan- 
ner 6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bi-level image data). 
A step S95A following the step S94 transfers the binary 
image data from the scanner 6 to the data compressor/ 
expander 8A. Then, the step S95A activates the data 
compressor/expander 8A so that the binary image data 
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is compressed by the device 8 into compression- result- 
ant image data of a given facsimile format. 
[0161] A step S95B subsequent to the step S95A 
transfers the compression-resultant image data of the 
5 facsimile format from the data compressor/expander 8A 
to the modem 18. The step S95B activates the modem 
18 so that the compression-resultant image data of the 
facsimile format (that is, the facsimile signal) is output- 
ted from the modem 1 8 to the telephone line. Normally, 

10 the facsimile signal is transmitted via the telephone line 
to the communication opposite party identified by the 
destination telephone number. After the step S95B, the 
current execution cycle of the program segment ends. 
[01 62] The step S96 decides whether or not informa- 

15 tion of the destination or the address of an e-mail to be 
transmitted has been inputted via the operation panel 
7F. In addition, the step S96 decides whether or not the 
start button on the operation panel 7F has been de- 
pressed. In the case where information of the destina- 

20 ton of an e-mail to be transmitted has been inputted and 
the start button on the operation panel 7F has been de- 
pressed, the program advances from the step S96 to a 
step S97. Otherwise, the program repeats the step S96. 
Thus, the step S96 waits the reception of information of 

25 an e-mail destination and the depression of the start but- 
ton. 

[0163] The step S97 activates the scanner 6 so that 
an image of the surface of a document sheet in the scan- 
ner 6 is converted by the scanner 6 into corresponding 

30 binary image data (corresponding bi-level image data). 
A step S98A following the step S97 transfers the binary 
image data from the scanner 6 to the data compressor/ 
expander 8 A. Then, the step S98A activates the data 
compressor/expander 8A so that the binary image data 

35 is compressed by the device 8 into compression-result- 
ant image data of a given facsimile format. Further, the 
step S98A transfers the compression-resultant image 
data of the facsimile format from the data compressor/ 
expander 8A to the storage unit 4 before storing the 

40 compression-resultant image data of the facsimile for- 
mat into the storage unit 4. In the case where the trans- 
mission of information on a plurality of document sheets 
(that is, a plurality of pages) is required, the document 
sheets are sequentially scanned by the device 6 and the 

45 compression-resultant image data of the facsimile for- 
mat is stored into the storage unit 4 as a single file having 
a plurality of pages. 

[0164] A step S98B following the step S98A transfers 
the compression-resultant image data of the facsimile 

so format from the storage unit 4 to the format converter 5. 
The step S98B activates the format converter 5 so that 
the compression-resultant image data of the facsimile 
format is converted by the device 5 into corresponding 
image data of the e-mail format. In addition, the step 

55 S98B transfers the image data of the e-mail format from 
the format converter 5 to the storage unit 4 before stor- 
ing the image data of the e-mail format into the storage 
unit 4. 
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[01 65] A step S99 subsequent to the step S98B trans- 
fers the image data of the e-mail format from the storage 
unit 4 to the LAN controller 9. The step S99 activates 
the LAN controller 9 so that the image data of the e-mail 
format is further transferred from the LAN controller 9 to 
an e-mail computer 9A. The image data of the e-mail 
format, that is, an e-mail, is transmitted from the e-mail 
computer 9A to the destination via an e-mail network 
9B. After the step S99, the current execution cycle of 
the program segment ends. 

Thirteenth Embodiment 

[0166] A thirteenth embodiment of this invention is 
similar to the embodiment of Figs. 24 and 25 except for 
design changes described hereinafter. 
[01 67] Fig. 26 is a flowchart of a segment of a program 
for controlling a CPU 1 (see Fig. 24) in the thirteenth 
embodiment. With reference to Fig. 26, a first step S 101 
in the program segment decides whether or not data of 
the e-mail format has been received by a LAN controller 
9 (see Fig. 24). This decision is to wait the reception of 
data of the e-mail format. In the case where data of the 
e-mail format has been received, the step S101 trans- 
fers the received data of the e-mail format to a storage 
unit 4 (see Fig. 24). The step S1 01 controls the storage 
unit 4 so that the received data of the e-mail format is 
stored into the storage unit 4. 

[01 68] A step S1 02 following the step S1 01 decides 
whether or not the received data of the e-mail format 
agrees with image data of the e-mail format by referring 
to related information in the header of the received data 
of the e-mail format. When the received data agrees with 
image data, the program advances from the step S102 
to a step S1 03. When the received data differs from im- 
age data, the program advances from the step S102 to 
a step S1 04. The step S1 03 transfers the received data 
of the e-mail format from the storage unit 4 to an inverse 
format converter 10 (see Fig. 24). The step S103 acti- 
vates the inverse format converter 10 so that the re- 
ceived data of the e-mail format is converted by the de- 
vice 10 into corresponding image data of a given fac- 
simile format. The step 104 controls a LAN controller 9 
(see Fig. 24) so that a responsive e-mail representing 
an error will be transmitted to the source concerning the 
received data of the e-mail format. After the step S1 04, 
the current execution cycle of the program segment 
ends. 

[01 69] A step S 1 05 following the step S 1 03 transfers 
the image data of the facsimile format from the inverse 
format converter 1 0 to a data compressor/expander 8A 
(see Fig. 24). The step S105 activates the data com- 
pressor/expander 8A so that the image data of the fac- 
simile format is expanded by the device 8A into expan- 
sion-resultant binary image data (expansion-resultant 
bi-level image data). Further, the step S105 transfers 
the expansion-resultant binary image data from the data 
compressor/expander 8A to the storage unit 4 before 
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storing the expansion-resultant binary image data into 
the storage unit 4. 

[0170] A step S106 subsequent to the step S105 
transfers the expansion-resultant binary image data 
5 from the storage unit 4 to a printer 11 (see Fig. 24). The 
step S1 06 activates the printer 1 1 so that the expansion- 
resultant binary image data is visualized or printed out 
by the device 11. 

[01 71] A step S1 07 following the step S1 06 decides 
10 whether or not a reception waiting flag has been set. 
When the reception waiting flag has been set, the pro- 
gram advances from the step S1 07 to a step S1 08. Oth- 
erwise, the program exits from the step S107, and the 
current execution cycle of the program segment ends. 
15 [01 72] The step 1 08 controls the LAN controller 9 so 
that an e-mail representing a reception notice will be 
transmitted to a previously-registered terminal (a previ- 
ously-registered terminal station). After the step S108, 
the current execution cycle of the program segment 

20 ends. 

[01 73] Setting the reception waiting flag is implement- 
ed by previously transmitting an e-mail in which a text 
has "IRCV SET according to the format of Fig. 17. Re- 
setting the reception waiting flag is implemented by 
25 transmitting an e-mail in which a text has "IRCV RESET" 
according to the format of Fig. 1 7. 

Fourteenth Embodiment 

30 [0174] A fourteenth embodiment of this invention is 
similar to the embodiment of Figs. 24 and 25 except for 
design changes described hereinafter. 
[01 75] Fig. 27 is a flowchart of a segment of a program 
for controlling a CPU 1 (see Fig. 24) in the fourteenth 

35 embodiment. With reference to Fig. 27, a first step S1 1 0 
in the program segment decides whether or not image 
data of the e-mail format (an e-mail) has been received 
by a LAN controller 9 (see Fig. 24). This decision is to 
wait the reception of image data of the e-mail format. In 

40 the case where image data of the e-mail format has 
been received, the step S1 1 0 transfers the received im- 
age data of the e-mail format to a storage unit 4 (see 
Fig. 24). The step S110 controls the storage unit 4 so 
that the received image data of the e-mail format is 

45 stored into the storage unit 4. 

[01 76] A step S111 following the step S1 1 0 transfers 
the received image data of the e-mail format from the 
storage unit 4 to an inverse format converter 10 (see 
Fig. 24). The step Sill activates the inverse format con- 

50 verter 1 0 so that the received image data of the e-mail 
format is converted by the device 1 0 into corresponding 
image data of a given facsimile format. Then, the step 
S111 transfers the image data of the facsimile format 
from the inverse format converter 1 0 to the storage unit 

55 4 before storing the image data of the facsimile format 
into the storage unit 4. 

[0177] A step S112 subsequent to the step S111 an- 
alyzes the "Subject" part of the header of the received 
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e-mail. In the case where the analyzed "Subject" part of 
the header includes a requirement for facsimile trans- 
mission, the step S112 extracts information of a desti- 
nation telephone number from a portion of the received 
e-mail which immediately follows the "Subject" part. 5 
[0178] A step S113 following the step S112 decides 
whether or not a requirement for facsimile transmission 
is present. When a requirement for facsimile transmis- 
sion is present, the program advances from the step 
S 1 1 3 to a step S 1 1 4. Otherwise, the program advances io 
from the step S113 to a step S115A. 
[01 79] The step S1 1 4 transfers the image data of the 
facsimile format from the storage unit 4 to a modem 1 8 
(see Fig. 24). The step S114 activates the modem 18 
so that the image data of the facsimile format (that is, is 
the facsimile signal) is outputted from the modem 1 8 to 
a telephone line. Normally, the facsimile signal is trans- 
mitted via the telephone line to the communication op- 
posite party identified by the destination telephone 
number. After the step S1 1 4, the current execution cycle 20 
of the program segment ends. 

[0180] A step S115A transfers the image data of the 
facsimile format from the storage unit 4 to a data com- 
pressor/expander 8A (see Fig. 24). The step S11 5A ac- 
tivates the data compressor/expander 8A so that the im- 25 
age data of the facsimile format is expanded by the de- 
vice 8A into expansion-resultant binary image data (ex- 
pansion-resultant bi-level image data). Further, the step 
S115A transfers the expansion-resultant binary image 
data from the data compressor/expander 8A to the stor- 30 
age unit 4 before storing the expansion-resultant binary 
image data into the storage unit 4. 
[0181] A step S115B subsequent to the step S115A 
transfers the expansion-resultant binary image data 
from the storage unit 4 to a printer 1 1 (see Fig. 24). The 35 
step S115B activates the printer 11 so that the expan- 
sion-resultant binary image data is visualized or printed 
out by the device 1 1 . After the step S1 1 5B, the current 
execution cycle of the program segment ends. 

40 

Fifteenth Embodiment 

[0182] Fig. 28 shows a fifteenth embodiment of this 
invention which is similar to the embodiment of Figs. 24 
and 25 except for an additional arrangement described 
hereinafter. 

[0183] With reference to Fig. 28, an electronic mail 
system includes a CPU 1 , a ROM 2, a RAM 3, a storage 
unit 4, a format converter 5, a scanner 6, an operation 
panel 7F, a data compressor/expander 8A, a LAN (local so 
area network) controller 9, an inverse format converter 
10, a printer 11 , a font memory 12, a character recogni- 
tion unit 13, an audio input/output device 14, an audio 
compressor/expander 15, a video input/output device 
16, a moving-picture compressor/expander 17, a mo- 55 
dem 1 8, and a world clock 1 9 which are electrically con- 
nected via a bus line. Trie world dock 19 generates in- 
formation of standard time in every country in the world. 
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[01 84] The CPU 1 operates in accordance with a pro- 
gram stored in the ROM 2. Fig. 29 is a flowchart of a 
segment of the program. With reference to Fig. 29, a 
first step S1 21 in the program segment decides whether 
or not information of the destination or the address of 
an e-mail to be transmitted has been inputted via the 
operation panel 7F. In the case where the information of 
the destination of an e-mail to be transmitted has been 
inputted, the program advances from the step S121 to 
a step S122. Otherwise, the program repeats the step 
S121 . Thus, the step S121 waits the reception of desti- 
nation information. 

[0185] The step S122 sets desired time for e-mail 
transmission which is expressed according to standard 
time in a country having an e-mail destination. A step 
S123 following the step S122 decides whether or not 
the start button on the operation panel 7F has been de- 
pressed. In the case where the start button on the op- 
eration panel 7F has been depressed, the program ad- 
vances from the step S123 to a step S124. Otherwise, 
the program repeats the step S1 23. Thus, the step S1 23 
waits the depression of the start button. 
[01 86] The step S1 24 activates the scanner 6 so that 
an image of the surface of a document sheet in the scan- 
ner 6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bi-level image data). 
A step S1 25A following the step S124 transfers the bi- 
nary image data from the scanner 6 to the data com- 
pressor/expander 8A. Then, the step S125A activates 
the data compressor/expander 8A so that the binary im- 
age data is compressed by the device 8A into compres- 
sion-resultant image data of a given facsimile format. 
Further, the step S125A transfers the compression-re- 
sultant image data of the facsimile format from the data 
compressor/expander 8A to the storage unit 4 before 
storing the compression-resultant image data of the fac- 
simile format into the storage unit 4. 
[0187] A step S125B following the step S125A trans- 
fers the compression-resultant image data of the fac- 
simile format from the storage unit 4 to the format con- 
verter 5. In addition, the step S1 25B transfers the infor- 
mation of the e-mail destination to the format converter 
5. The step S125B activates the format converter 5 so 
that the compression-resultant image data of the fac- 
simile format is converted by the device 5 into corre- 
sponding image data of the e-mail format. Further, the 
step S1 25B transfers the image data of the e-mail format 
from the format converter 5 to the storage unit 4 before 
storing the image data of the e-mail format into the stor- 
age unit 4. 

[0188] A step S126 following the step S1 25B detects 
a destination's country from the inf ormation of the e-mail 
destination. It is well-known that an end part of informa- 
tion of an e-mail destination indicates the destination's 
country. A step S127 subsequent to the step S126 de- 
tects present time in the destination's country by refer- 
ring to the information generated by the world clock 19. 
The step S1 27 decides whether or not the present time 
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in the destination's country reaches the desired time for 
e-mail transmission. This decision is to wait a moment 
at which the present time in the destination's country 
reaches the desired time for e-mail transmission. In the 
case where the present time in the destination's country 
reaches the desired time for e-mail transmission, the 
step S1 27 transfers the image data of the e-mail format 
from the storage unit 4 to the LAN controller 9. The step 
S127 activates the LAN controller 9 so that the image 
data of the e-mail format is further transferred from the 
LAN controller 9 to an e-mail computer 9A. The image 
data of the e-mail format, that is, an e-mail, is transmit- 
ted from the e-mail computer 9A to the destination via 
an e-mail network 9B. After the step S127, the current 
execution cycle of the program segment ends. 

Sixteenth Embodiment 

[0189] A sixteenth embodiment of this invention is 
similar to the embodiment of Figs. 24 and 25 except for 
design changes described hereinafter. 
[01 90] Fig. 30 is a flowchart of a segment of a program 
for controlling a CPU 1 (see Fig. 24) in the sixteenth em- 
bodiment. With reference to Fig. 30, a first step S131 in 
the program segment decides whether or not image da- 
ta of the e-mail format (an e-mail) has been received by 
a LAN controller 9 (see Fig. 24). This decision is to wait 
the reception of image data of the e-mail format, in the 
case where image data of the e-mail format has been 
received, the step S131 transfers the received image 
data of the e-mail format to a storage unit 4 (see Fig. 
24). The step S131 controls the storage unit 4 so that 
the received image data of the e-mail format is stored 
into the storage unit 4. 

[0191] A step S132 following the step S131 transfers 
the received image data of the e-mail format from the 
storage unit 4 to an inverse format converter 1 0 (see 
Fig. 24). The step S132 activates the inverse format 
converter 10 so that the received image data of the e- 
mail format is converted by the device 10 into corre- 
sponding image data of the facsimile format. 
[0192] A step S133 subsequent to the step S132 
transfers the image data of the facsimile format from the 
inverse format converter 1 0 to the storage unit 4, and 
then storing the image data of the facsimile format into 
a box which is provided in the storage unit 4 for the re- 
lated destination. It should be noted that boxes provided 
in the storage unit 4 have a correspondence relation with 
previously-registered owner's ID information and previ- 
ously-registered pass words. 

[0193] A step S134 following the step S133 decides 
whether or not owner's ID information and a pass word 
are inputted. This decision is to wait the reception of 
owner's ID information and a pass word. In the case 
where owner's ID information and a pass word are in- 
putted, the step S1 34 decides whether or not the input- 
ted owner's ID information and the inputted pass word 
are acceptable. In the case where the inputted owner's 
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ID information and the inputted pass word are accepta- 
ble, the program advances from the step S1 34 to a step 
S135A. Otherwise, the current execution cycle of the 
program segment ends. 

5 [0194] The step S135A reads out the image data of 
the facsimile format from the box in the storage unit 4 
which corresponds to the inputted owner's ID informa- 
tion and the inputted pass word. The step S135A trans- 
fers the image data of the f acsimi le format to a data com- 

10 pressor/expander 8A (see Fig. 24). The step S135A ac- 
tivates the data compressor/expander 8A so that the im- 
age data of the facsimile format is expanded by the de- 
vice 8A into expansion-resultant binary image data (ex- 
pansion-resultant bi-level image data). 

15 [01 95] A step S1 35B subsequent to the step S1 35A 
transfers the expansion-resultant binary image data 
from the data compressor/expander 8A to a printer 11 
(see Fig. 24). The step S135B activates the printer 11 
so that the expansion-resultant binary image data is vis- 

20 ualized or printed out by the device 1 1 . After the step 
S135B, the current execution cycle of the program seg- 
ment ends. 

Seventeenth Embodiment 

25 

[01 96] A seventeenth embodiment of this invention is 
similar to the embodiment of Fig. 30 except for design 
changes described hereinafter. In the seventeenth em- 
bodiment, the step S134 is omitted from the program 
30 segment of Fig. 30, and the step S133 is immediately 
followed by the step S135A. 

[01 97] Information of owner's cover sheet is previous- 
ly registered in a related box of a storage unit 4 (see Fig. 
24). The registration is implemented by using a scanner 
35 6 (see Fig. 24) or transmitting an e-mail having a cover- 
sheet registering instruction. 

[0198] In the seventeenth embodiment, the step 
S135B is modified so that information of a cover sheet 
is read out from the storage unit 4, and the information 
40 of the cover sheet is added to expansion-resultant bina- 
ry image data. Accordingly, a combination of the cover- 
sheet information and the expansion-resultant binary 
image data is visualized or printed out by a printer 11 
(see Fig. 24). 

45 

Eighteenth Embodiment 

[0199] An eighteenth embodiment of this invention is 
similar to the embodiment of Figs. 24 and 25 except for 
so design changes described hereinafter. 

[0200] Fig. 31 is a flowchart of a segment of a program 
for controlling a CPU 1 (see Fig. 24) in the eighteenth 
embodiment. With reference to Fig. 31 , a first step S1 41 
in the program segment decides whether or not image 
55 data of the e-mail format (an e-mail) has been received 
by a LAN controller 9 (see Fig. 24). This decision is to 
wait the reception of image data of the e-mail format. In 
the case where image data of the e-mail format has 
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been received, the step S141 transfers the received im- 
age data of the e-mail format to a storage unit 4 (see 
Fig. 24). The step S141 controis the storage unit 4 so 
that the received image data of the e-mail format is 
stored into the storage unit 4. 

[0201] A step S142 following the step S141 transfers 
the received image data of the e-mail format from the 
storage unit 4 to an inverse format converter 1 0 (see 
Fig. 24). The step S142 activates the inverse format 
converter 10 so that the received image data of the e- 
mail format is converted by the device 10 into corre- 
sponding image data of a given facsimile format. The 
step S142 transfers the image data of the facsimile for- 
mat to the storage unit 4 before storing the image data 
of the facsimile format into the storage unit 4. 
[0202] A step S1 43A f ollowi ng the step S 1 42 transfers 
the image data of the facsimile format from the storage 
unit 4 to a data compressor/expander 8A (see Fig. 24). 
The step S1 43A activates the data compressor/expand- 
er 8A so that the image data of the facsimile format is 
expanded by the device 8A into expansion-resultant bi- 
nary image data (expansion-resultant bi-level image da- 
ta). 

[0203] A step S143B subsequent to the step S143A 
transfers the expansion-resultant binary image data 
from the data compressor/expander 8A to a printer 1 1 
(see Fig. 24). The step S143B activates the printer 11 
so that the expansion-resultant binary image data is vis- 
ualized or printed out by the device 11 . 
[0204] A step S 1 44 detects inf ormatio n of the address 
of a sender related to the received e-mail. Trie step 1 44 
controls a LAN controller 9 (see Fig. 24) so that a re- 
sponsive e-mail confirming e-mail reception will be 
transmitted to the sender address. After the step S144, 
the current execution cycle of the program segment 
ends. 

Nineteenth Embodiment 

[0205] A nineteenth embodiment of this invention is 
similar to the embodiment of Figs. 24 and 25 except for 
design changes described hereinafter. 
[0206] Fig. 32 is a flowchart of a segment of a program 
for controlling a CPU 1 (see Fig. 24) in the nineteenth 
embodiment. With reference to Fig. 32, a first step S151 
in the program segment decides whether or not image 
data of the e-mail format (an e-mail) has been received 
by a LAN controller 9 (see Fig. 24). This decision is to 
wait the reception of image data of the e-mail format. In 
the case where image data of the e-mail format has 
been received, the step S1 51 transfers the received im- 
age data of the e-mail format to a storage unit 4 (see 
Fig. 24). The step S151 controls the storage unit 4 so 
that the received image data of the e-mail format is 
stored into the storage unit 4. 

[0207] A step S1 52 following the step S1 51 transfers 
the received image data of the e-mail format from the 
storage unit 4 to an inverse format converter 10 (see 
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Fig. 24). The step S152 activates the inverse format 
converter 1 0 so that the received image data of the e- 
mail format is converted by the device 10 into corre- 
sponding image data of a given facsimile format. 

5 [0208] A step S1 53A following the step S1 52 adds re- 
ception ID information to the image data of the facsimile 
format. The reception ID information is generated on the 
basis of date and time unique for one year. The step 
S153A transfers the ID-added image data of the facsim- 

10 ile format to the storage unit 4 before storing the ID-add- 
ed image data of the facsimile format into the storage 
unit 4. 

[0209] A step S153B subsequent to the step S153A 
transfers the ID-added image data of the facsimile for- 
15 mat from the storage unit 4 to a data compressor/ex- 
pander 8A (see Fig. 24). The step S153B activates the 
data compressor/expander 8A so that the ID-added im- 
age data of the facsimile format is expanded by the de- 
vice 8A into expansion-resultant binary image data (ex- 
20 pansion-resultant bi-level image data). 

[0210] A step S1 53C subsequent to the step S1 53B 
transfers the expansion-resultant binary image data 
from the data compressor/expander 8A to a printer 11 
(see Fig. 24). The step S153C activates the printer 11 
25 so that the expansion-resultant binary image data is vis- 
ualized or printed out by the device 11 . 
[021 1 ] A step S 1 54 following the step S1 53C decides 
whether or not information equal to the reception ID in- 
formation added to the image data has been inputted 
30 via an operation panel 7F (see Fig. 24). In the case 
where such reception ID information has been inputted, 
the program advances from the step S154 to a step 
S155. Otherwise, the program repeats the step S154. 
Thus, the step S154 waits the reception of the ID infor- 
ms mation. 

[0212] The step S1 55 analyzes the header of the re- 
ceived e-mail, and thereby detects a sender address 
corresponding to the reception ID information. The step 
S1 55 controls a LAN controller 9 (see Fig. 24) so that a 
40 responsive confirmation e-mail will be transmitted to the 
sender address. After the step S1 55, the current execu- 
tion cycle of the program segment ends. 

Twentieth Embodiment 

45 

[0213] A twentieth embodiment of this invention is 
similar to the embodiment of Figs. 24 and 25 except for 
design changes described hereinafter. 
[021 4] Fig. 33 is a flowchart of a segment of a program 

50 for controlling a CPU 1 (see Fig. 24) in the twentieth em- 
bodiment. With reference to Fig. 33, a first step S1 61 in 
the program segment decides whether or not character 
code data in an e-mail has been received by a LAN con- 
troller 9 (see Fig. 24). This decision is to wait the recep- 

55 tion of character code data in an e-mail. In the case 
where the character code data in the e-mail has been 
received, the program advances from the step S161 to 
a step S162. The step S162 analyzes the "From 0 part 
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of the header of the e-mail to detect a sender address. 
[0215] A step S1 63 following the step S162 decides 
whether or not the sender address agrees with a given 
address assigned to the present e-mail system. When 
the sender address agrees with the given address, the 
program advances from the step S1 63 to a step S1 64. 
Otherwise, the program advances from the step S163 
to a step St 65. 

[0216] The step S1 64 transfers a signal indicative of 
a transmission failure to a printer 11 (see Fig. 24). The 
step S1 64 activates the printer 11 so that the transmis- 
sion failure signal is visualized or printed out by the de- 
vice 1 1 . After the step S1 64, the current execution cycle 
of the program segment ends. 
[0217] The step S165 converts character code data 
in the text into corresponding image data. A step S166 
following the step S1 65 transfers the image data to the 
printer 1 1 . The step S1 66 activates the printer 1 1 so that 
the image data is visualized or printed out by the device 
11 . After the step S166, the current execution cycle of 
the program segment ends. 

Other Embodiments 

[0218] Any one of the second embodiment to the 
twentieth embodiment may be modified to indicate char- 
acter code data in the received e-mail on a display such 
as a CRT. The CRT may also be used to indicate moving 
pictures. 

[021 9] At least two of the f irst embodiment to the twen- 
tieth embodiment may be combined into an electronic 
mail system. 



Claims 

1 . A facsimile type electronic mail apparatus compris- 
ing: 

a scanner (6) for scanning a paper document 
to convert the image of the document into cor- 
responding image data; 

a compression device (8A) for compressing the 
image data; 

a data format converter (5) for converting the 
compressed image data into an electronic mail 
format; 

an operation panel (7F) having an input key for 
inputting a destination telephone number or a 
destination address of an electronic mail; 
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network (9B); 

a fax modem (1 8) for transmitting the image da- 
ta to the destination determined by the input tel- 
5 ephone number via a telephone network ac- 

cording to a facsimile protocol; 

characterised by 

further comprising a decision device (1 ) for deciding 
io whether the image data is transmitted via the tele- 
phone network according to the facsimile protocol 
or is transmitted via the computer communication 
network (9B) according to the electronic mail proto- 
col, based on a result of selection by an operator. 

15 

2. The apparatus according to claim 1 characterised 
in that the operation panel (7F) has a selection but- 
ton, and that said decision device is adapted to de- 
cide whether the image data is transmitted accord- 

20 ing to the facsimile protocol or the electronic mail 
protocol based on whether or not the selection but- 
ton has been operated by the operator. 

3. The apparatus according to claim 1 or 2 character- 
's ised in that said operation panel (7F) has a start 

key to start a transmitting operation, and that said 
scanner (6), said compression device (8A), said da- 
ta format converter (5) and the electronic mail trans- 
mitter (9A) are sequentially operated in the order to 
30 transmit image data via the network according to 
the electronic mail protocol when said start key is 
pushed after setting the paper document on said 
scanner (6) and finishing the input of the destination 
address of an electronic mail by using said inputting 
35 key. 

4. The apparatus according to one of claims 1 to 3 
characterised by further comprising a local area 
network (LAN) controller (9) for connecting the fac- 

40 simile type electronic mail apparatus to the compu- 
ter communication network which is a local area 
network. 

5. A method for controlling a facsimile type electronic 
45 mail apparatus which is able to transmit image data 

via a telephone network according to a facsimile 
protocol or via a computer communication network 
according to an electronic mail protocol, said meth- 
od comprising the steps of: 

50 

controlling a scanner in order to scan a paper 
document to convert the image of said docu- 
ment into corresponding image data; 

controlling a compression device in order to 
compress the image data; 

controlling a data format converter in order to 



an electronic mail transmitter (9 A) for transmit- 55 
ting the format-converted image data to the 
destination address according to an electronic 
mail protocol via a computer communication 
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convert the compressed image data into an 
electronic format; 

controlling an input key of an operation panel 
in order to input a destination telephone 5 
number or destination address of an electronic 
mail; 

controlling an electronic mail transmitter in or- 
der to transmit the format-converted image da- 10 
ta to the destination address according to an 
electronic mail protocol via a computer commu- 
nication network; and 

controlling a fax modem in order to transmit the 15 
image data via the telephone network accord- 
ing to the facsimile protocol; 

characterised by further comprising steps of: 
selecting by an operator whether the image data is 20 
transmitted via the telephone network according to 
the facsimile protocol or is transmitted via the com- 
puter communication network according to the elec- 
tronic mail protocol. 

25 

6. The method according to claim 5 characterised in 
that said operator uses said operation panel for the 
selection step. 

7. The method according to claims 5 or 6 character- 30 
ised in that in the selection step, a decision of 
whether the image data is transmitted according to 
the facsimile protocol or according to the electronic 
mail protocol is performed based on whether or not 

a selection button of the operation panel has been 35 
operated by the operator. 

8. The method according to one of claims 5 to 7 char- 
acterised by further comprising the step of control- 
ling sequentially said scanner, said compression *o 
device, said data format converter and the electron- 
ic mail transmitter in the order to transmit image da- 
ta via the computer communication 

9. network according to the electronic mail protocol *s 
when a start key of said operation panel is pushed 
after setting the paper document on said scanner 
and finishing the input of the destination address of 

an electronic mail. 



20 



EP1 139 645 A2 



FIG. 1 




STORAGE 
UNIT 



FORMAT 
CONVERTER 



DATA COMPRESS 



8 



LAN CONTROL 



^ LAN 



E-MA I L 
COMPUTER 



V 



9A 



E-MAIL 
NETWORK 



9B 



21 



EP 1 139 645 A2 



FIG. 2 



C 



START 



3 



si 



DESTINATION START 
BUTTON DEPRESSION 




r 




ACTIVATE SCANNER 




f 




COMPRESS DATA 




' 




FORMAT CONVERSION 
OF IMAGE DATA 




f 




TRANSM 


ISSION 



S2 



S3 



S4 



S5 



c 



END 



3 



22 



EP 1 139 645 A2 



FIG. 3 




10 



STORAGE 
UNIT 



FORMAT 
CONVERTER 



INVERSE FORMAT 
CONVERTER 



DATA 

COMPRESS/EXPAND 



8A 



LAN CONTROL 



' LAN 



PRINTER 



11 



E-MA I L 
COMPUTER 



V 



9A 



E-MA I L 
NETWORK 



9B 



23 



EP1 139 645 A2 



r 

FIG. 4 



( START ) 




S12B 



INVERSE CONVERSION 
OF IMAGE DATA 




F 




EXPAND DATA 




r 




PRI 


INT 



si 



TRANSMIT E-MAIL 
REPRESENTING ERROR 



c 



END 



24 



EP 1 139 645 A2 



FIG. 5 




XT 



XT 



STORAGE 
UNIT 



FORMAT 
CONVERTER 



XT 



INVERSE FORMAT 
CONVERTER 




DATA 

COMPRESS/EXPAND 



8A 



LAN CONTROL 



S LAN 



PRINTER 



V 



n 



E-MA I L 
COMPUTER 



E-MAIL 
NETWORK 



25 



EP 1 139 645 A2 



FIG. 6 



START ) 





,~ S2 ' 


RECEPTION OF CHARACTER CODE DATA 






^S22B 


CONVERSION INTO IMAGE DATA 
IN RESPONSE TO FONT DATA 






,~ S23 


PRINT 






t 





( m ) 



26 



EP 1 139 645 A2 
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FIG. 10 
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FIG. 11 
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FIG. 12 
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FIG. 13 
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